IRIS EXTRACTION METHOD 

BACKGROUND OF THE INVENTION 



1 . Field of the Invention 

The present invention relates to the technical field of face 
5 recognition and, more particularly, to an iris extraction method. 

2. Description of Related Art 

Currently, in the technical field of face recognition used for 
analyzing and determining digital face images, the basic requirement is to 
determine the position or range of eyes in an image so as to continue 

1 0 subsequent processes of recognition. For example, in a full-face recognition, 
a rough position of eyes is required for aligning an untested image and a 
reference image. While with the development of information technology, 
the desired precision of recognition is getting stricter. For example, the 
conventional recognition method used for determining the direction of the 

1 5 user's sight needs not only the correct position of the center of eyes, but also 
the exact location of irises as an assistant. With reference to FIG. 1, there is 
shown an eye image 1. The annular area around the pupil 11 is an iris 12. 
The color of iris 12 differs from each other, which may be black, green, blue, 
or brown. The white area exposed in the surface of eyeball is a sclera 13. 

20 Compared with skin color, irises are circular dark areas in a face 

image. Therefore, the most popular conventional methods used for 
extracting irises in the face image include the circle Hough transform (CHT) 
method, and the deformable template match (DTM) method. 

In the conventional method, at first, two searching regions are 



roughly defined as a pair of eyes in an input image. Next, a predefined 
energy function is used for measuring the energy of each pixel in the 
searching region. Each pixel is taken as a center of a circle with a radius rj 
(i=l~n, r n is the maximal radius, i\ is the minimal radius), so as to build a 
5 circular deformable template. The energy function can be expressed as 
follows: 

Eg = <£ ^ (s)ds + JL J £ M/ (a)dxdy , 

where <j)(S) is an edge intensity of one of the pixels in the periphery of the 
circular template, \|/(a) is a gray value of the pixel of input image within 

10 the range of the circular template. Usually, an original inputted gray- value 
image is required to obtain an edge map with the distribution of edge 
intensity by performing a contract operation, such as Sobel operators. Since 
a pixel has n energies due to n different sizes (radiuses) of circular templates, 
the maximal energy of a pixel is regarded as the energy of the pixel. Then, 

1 5 two pixels are respectively selected from two searching regions as positions 
of irises so as to finish the iris-positioning procedure, where each pixel is 
the one with the maximal energy of a plurality of pixels in the searching 
region. 

However, generally, irises are partially visible in an input image in 
20 reality. Even though when the eyes look forward, only two-third irises are 
visible. Further, in most situations, eyelids may cover upper irises, 
especially when the eyeball is rotating or the eyes are looking sideways. 
Also, the uncertainty (e.g. uneven light) of photo environment and the local 



circular-like dark areas of surrounding objects (e.g. eyebrows, eyeglasses, 
and hair) may lead to misjudge the eyebrows or glasses as best positions of 
irises according to conventional method. Therefore, it is desirable to 
provide an improved iris extraction method to mitigate and/or obviate the 
5 aforementioned problems. 

SUMMARY OF THE INVENTION 

An object of the present invention is to provide an iris extraction 
method in which a modified deformable template match (DTM) algorithm 
with improved energy function and measurement way is used, thereby the 

10 positions and sizes of irises in a digital face image can be precisely 

» 

determined. 

Another object of the present invention is to provide an iris 
extraction method in which the selected iris candidates in image search 
regions are paired with each other for determining precise positions of irises, 

1 5 thereby reducing the interference of other objects. 

To achieve the objects, the iris extraction method of the present 
invention comprises the steps of: (A) defining two searching regions in a 
face image, wherein each searching region is a rough position of an eye for 
locating an iris; (B) measuring an energy of each pixel within the searching 

20 region according to a deformable template match (DTM) algorithm and an 
energy function, wherein each pixel is a center of a plurality of hypothetical 
circular templates each having a hypothetical radius between a maximal 
radius and a minimal radius for measuring the energies of the hypothetical 
circular templates in the face image; (C) recording the pixels with the same 



hypothetical radius having energies greater than a threshold as iris 
candidates, and recording a pixel having the maximal energy from the iris 
candidates as a first iris candidate; (D) comparing two of the iris candidates 
in each searching region for detecting a plurality of associated iris pairs, and 
5 recording the lower iris candidate having the maximal energy of the iris 
pairs as a second iris candidate; (E) selecting the pixel corresponding to the 
second iris candidate as a best iris candidate if the distance between the first 
iris candidate and the second iris candidate is smaller than a predetermined 
radius; and (F) designating the best iris candidate having the maximal 

10 energy of all best iris candidates with different hypothetical radius as an iris 
in the face image. Further, if none of the associated iris pairs is detected 
from the iris candidates, the first iris candidate is designated as the best iris 
candidate in the face image. And the center and radius of the designated 
best iris candidate is the desired iris. 

15 Other objects, advantages, and novel features of the invention will 

become more apparent from the following detailed descriptions when taken 
in conjunction with the accompanying drawings. 
BRIEF DESCRIPTION OF THE DRAWINGS 
FIG. 1 is a schematic drawing of an eye; 

20 FIG. 2 is a flow chart according to the invention; 

FIG. 3 is a schematic drawing of a face image according to the 
invention; 

FIG. 4 is a schematic drawing of a circular deformable template 
according to the invention; 



FIG. 5 schematically illustrating measurement values extracted 
from the hypothetical circular template according to the invention; 

FIG 6 schematically illustrating the definition of weighting factors 
in the hypothetical circular template according to the invention; 
5 FIG 7 is a flow chart illustrating a process of comparing iris 

candidates according to the invention; and 

FIG 8 is a schematic drawing of positions of irises determined in the 
face image according to the invention. * 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT 

10 With reference to FIGS. 2 and 3, there are shown a flow chart and a 

♦ 

face image, respectively, according to the present invention. At first, an 
image-process device obtains the range of a face image 3 by applying 
conventional face detection algorithm, and roughly detects the positions of 
two eyes El, E2. In this embodiment, two searching regions Rl, R2 are 

1 5 defined as a rectangle with the length of 0.8 time of the distance d e (i.e. 0 . 8 
xd e ) between eyes El, E2 and the width of 0.6 time of the distance d e (i.e. 
0.6 xd e ) (step S201). Thus the image-process device can locate the 
positions of irises in searching regions Rl, R2. 

Due to the approximately circular-shaped iris, a deformable 

20 template match (DTM) technique is used to define a circular deformable 
template as shown in FIG 4 in this embodiment. Each circular deformable 
template is applied in each pixel in searching regions Rl, R2 so as to 
calculate the energy of each pixel according to an energy function (step 
S202). The hypothetical radius r n of the hypothetical circular template D n is 



between a minimal radius ri and a maximal radius r 2 . In this embodiment, 
the minimal radius rj is 0.08 time of the distance d e (i.e. ri=0.08xd e ) 
between eyes El, E2 and the maximal radius is 0.13 time of the distance d e 
(i.e. r 2 =0.13xd e ). A plurality of hypothetical circular templates D n , each 
5 with the size between a minimal circular template Dj and a maximal 
circular template D 2 , are constructed while a pixel P(Xi,yO (i e R 1 orR2)is 
taken as a basis point. Therefore, the energy of each pixel under a plurality 
of different circular templates can be obtained according to the following 
energy function: 

10 , Eg = ^{4>(S)ds, - 

where C is a periphery of the hypothetical radius r n , ds is an increment of the 
periphery along the hypothetical circular template D n , <|)(S) is a 

measurement value of a sampling point on the periphery, |C| is the 
perimeter of the hypothetical circular template D n . 
15 FIG. 5 illustrates the definition of the measurement value of each 

sampling point. The measurement value of the sampling point S in this 
embodiment is as follows: 

♦(S) = 1.5*.(S) + t|> B (S) > 
where <j) e (S) = w(s)(g o - g. ) is a measurement value of a contrast between 

20 an outer intensity and an inner intensity of the periphery of the hypothetical 
circular template D n , <j) g (S) = 0. 1 x (255 - g.) is a measurement value of the 

inner dark degrees of the hypothetical circular template D n , g { is a 
gray-scale mean of the image inside a scanning line with the length equal to 



the hypothetical radius r n and the midpoint located on the periphery, g 0 is a 
gray-scale mean of the image outside the scanning line, w(s) is a weighting 
factor of the sampling point, and (|>(S) is a weighting summation of <j) e (S) 
and 4> f (S). 

5 In the integration process of the energy function according to the 

embodiment, one sampling point on the periphery is selected every 22.5° 
(i.e. the increment is 22.5°) along the lower half periphery of the 
hypothetical circular template D n (i.e. from 0° to 180°) in order to calculate 
(J)(S) , where E g is an accumulative summation of the selected nine* 

1 0 sampling points ((180^22. 5 ) + 1 = 9 ). It is noted that w(s) is a weighting 
factor of the sampling point for estimating the importance of the sampling 
point so that the sampling points located on the same hypothetical circular 
template D n would be defined with different weighting factors. Preferably, 
the sampling points close to the horizontal direction would be defined with 

15 higher weighting factors, otherwise, the sampling points close to the 
vertical direction would be defined with smaller weighting factors because 
irises may be covered by eyelids. With reference to FIG 6, there is shown 
the definition of weighting factors. Two sampling points on the x-axis (i.e. 
the horizontal direction) both have the weighting factor defined as "0.2", 

20 while other sampling points would have smaller weighting factors the more 
closer to the y-axis (i.e. the vertical direction). Further, the definition of 
weighting factors may differ according to the number of sampling points. 
The summation of all weighting factors of sampling points is "1.0", and 
thus |C| (the normalized divisor) of the energy function is also defined as 



"1.0". 

After all energies of pixels with various hypothetical circular 
template D n in the searching regions Rl, R2 are calculated by the 
image-process device* energies of pixels with each identical hypothetical 
5 radius r n would be respectively processed. That is, pixels with the same 
hypothetical radius having energies greater than a predetermined threshold 
are recorded as iris candidates (step S203). Then, the pixel having the 
maximal energy from the above pixels is recorded as a first iris candidate 
under the hypothetical radius r n (step S204). 

10 Next, the image -process device detects a plurality of associated iris 

pairs from the foregoing iris candidates (step S205). In addition to irises, 
other similar dark regions in the face image 3, such as glasses, eyebrows, 
and hair, may also influence the recognition result. Therefore, the 
comparison between every two iris candidates is required for detecting the 

15 associated upper and lower iris candidates as the iris pairs, such as the 
combination of eyebrow/iris, glasses/iris, hair/eyebrow, or iris/eye socket in 
the face image 3. It is noted that in each iris pair, the lower iris candidate is 
assumed to be a possible iris in this embodiment. 

With reference to FIG. 7, there is shown a process of the comparison 

20 between two of the iris candidates mentioned in step S205. At first, two 
coordinates of pixels of two iris candidates in the same searching region are 
obtained (step S701). For example, coordinates (x 1? yi) and (x 2 ,y2) of pixels 
Pi ,P 2 corresponding to two iris candidates are obtained. Then, the 
image-process device detects that P 2 is below Pi (in the y-axis direction), 



and the vertical distance between P! and P 2 is between 2 . 0 xr n and 6 . 0 xr n 
(namely, the predetermined vertical distance) (step S702). The 
image-process device further detects that the horizontal distance between Pi 
and P 2 is smaller than 2.0 xr n (namely, the predetermined horizontal 
5 distance) (step S703). Next, this two iris candidates would be designated as 
an iris pair (step S704). Otherwise, if the two selected iris candidates cannot 
satisfy the requirements of steps S702 and S703, the iris candidates are not 
associated with each other and thus it is not necessary to designate the iris 
pair (step S705). Certainly, the definition of either the predetermined 
10 vertical distance or the predetermined horizontal distance is not limited to 
the scope of the disclosed embodiment and can be defined according to 
users. 

With reference to FIG. 2 again, after all iris pairs are obtained, the 
lower iris candidate from the iris pairs having the maximal energy of iris 

15 pairs is recorded as a second iris candidate (step 207). 

The proceeding process is to select a best iris candidate from the 
first iris candidate and the second iris candidate having the same 
hypothetical radius r n . If the distance between the first iris candidate and the 
second iris candidate is larger than a predetermined distance (step S208), 

20 such as the hypothetical radius r n , and the energy of the first iris candidate is 
a predetermined multiple of the energy of the second iris candidate (step 
S209) (e.g. the energy of the first iris candidate is 1.5 times of that of the 
second iris candidate), the second iris candidate is the less possible location 
of the actual iris. Therefore, the first iris candidate is designated as the best 



iris candidate under its hypothetical radius r n (step S210). On the contrary, 
in step S208, if the distance between the first iris candidate and the second 
iris candidate is less than the hypothetical radius r n , the second iris 
candidate not only is associated with its upper iris candidate, but also much 
5 closer to the first iris candidate in the hypothetical circular template D n . 
Thus, the second iris candidate is designated as the best iris candidate under 
its hypothetical radius r n (step S212). 

In addition, in step S206, if none of the associated iris pairs is 
detected from the iris candidates, the first iris candidate is directly 

10 designated as the best iris candidate (step S21 1). 

Finally, the best iris candidate having the maximal energy of all best 
iris candidates with different hypothetical radius between the minimal 
radius T\ and the maximal radius r 2 is designated as the position of an iris 
(step S213). According to the aforesaid steps, positions of irises II, 12 as 

1 5 shown in FIG. 8 can be respectively determined in searching regionsTt 1 , R2 
of the face image 3, and the size of each iris is that of the hypothetical 
circular template corresponding to the finally selected iris candidate. 

In the present invention, the iris extraction method is improved on 
the basis of the circular DTM technique, and uses a redesigned energy 

20 function and the way of measurement according to conventional DTM 
technique so as to define a robust method. Therefore, irises are easily 
extracted under various kinds of face images. Besides, the process of 
comparison between iris candidates to detect associated iris pairs is also 
designed in the present invention so as to select the actual iris in imperfect 



face images, and thus reduce the interference of other objects. 

Although the present invention has been explained in relation to its 
preferred embodiment, it is to be understood that many other possible 
modifications and variations can be made without departing from the spirit 
5 and scope of the invention as hereinafter claimed. 



11 



